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when  the  signal  and  observation  processes  are  linear  and 
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linearity  in  the  signal  is  discussed  by  considering  stochastic 
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observation.  The  result  can  be  expressed  in  terms  of  Gaus¬ 
sian  densities 
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Filters  With  Small  Non-Linearities 


Robert  J.  Elliott 

Department  of  Statistics  and  Applied  Probability 
University  of  Alberta 
Edmonton,  Alberta,  Canada  T6G  2G1 


ABSTRACT 


The  OBSERVATION  process  is  taken  to  be  of  the  form 


The  Kalman  filter  provides  a  finite  dimensional  solution 

when  the  signal  and  observation  processes  are  linear  and  W  “  ^*fors(Io)^3  4-  Pt-  (1-4) 

have  Gaussian  noise.  In  this  paper  the  effect  of  a  small  non¬ 
linearity  in  the  signal  is  discussed  by  considering  stochastic 

flows  for  the  signal  and  a  Girsanov  transformation  for  the  As  usual,  we  shall  suppose  xq  is  a  Gaussian  Fq  measurable 

observation.  The  result  can  be  expressed  in  terms  of  Gaus-  random  variable  independent  of  wt,  f?j,  t  >  0. 


sian  densities. 


& 


In  this  section  we  first  describe  the  linear  Kalman  filter.  For 
simplicity  real  valued  signal  and  observation  processes  will 
be  considered;  the  vector  case  can  be  discussed  with  more 
complicated  notation  and  calculations.  b>f,  Bt,  t  >  0,  are 
two  independent  Brownian  motions  defined  on  a  probabil¬ 
ity  space  (fi,  F,  P)  which  has  a  complete,  right  continuous 
filtration  {Ft}  to  which  w  and  B  are  adapted,  a*,  t  >  0,  is 
a  locally  integrable,  measurable  function,  and  hf,  t  >  0,  is 
a  function  with  a  locally  integrable  derivative. 

Suppose  the  SIGNAL  is  described  by  the  linear  equation 
Xt=xs+  J  OuTudu+WJ.  (1.1) 

Write  the  solution  of  (1.1)  as  ^^(xj).  Supose  $(s,  t)  is  the 
solution  of 


di(3,t) 

dt 


=  <H *(3,t)dt, 

$(s,s)  =  1. 


Clearly,  $(s,t)  =  exp  ^  J  auduj  and 

£«,<(**)  =  *(M){*«  +  J  *(s,u)_1dwu|.  (1.3) 

Research  partially  supported  by  the  Natural  Sciences  and 
Engineering  Research  Council  of  Canada  under  grant 
A-7964,  and  the  U.S.  Army  Research  Office  under  contract 
DAAL03-87-K-0102. 


Write  (yj),  t  >  0,  for  the  right  continuous  complete  filtra¬ 
tion  generated  by  the  observations  and 

*t(*s)  =  E\*t  I  Yt ]  ^  *  >  3- 

Then  it  is  known  that  xt(x3)  is  a  Gaussian  random  variable 
for  t  >  s  and 

Xf(*»)  =  xt  +  J  auxu(xs)du 

+  f  Ps,uK(dyu  ~  hvXu(x3))du 

*  J •  n  si 


P^  =  E[x?|xJ,  Kt]-(£[x,|xs,  Yt})2 
satisfies  the  deterministic  equation 

'  ^  =  -h*Plt  +  2 atPs,t  +  1,  (1.6) 

Ps^  —  0- 

Consequently,  xj(ij)  is  Gaussian  with  conditional  mean 
it(zj)  and  variance  P3,t- 

Writing  if  =  |  V}}  we  see  x<  is  Gaussian  with  mean 

and  variance  P(  given  by 

it  =  E[xq]  +  f  atx,d3  +  /  P,h,(dy,  -  h,z,ds) 

JO  Jo  (1.7) 

?£■  =  -h^P?  +  2atP,  +  1,  (1.8) 

p0  =  £[*§] -(£[*0])2 
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The  equations  (1.5)  and  (1.6),  or  (1.7)  and  (1.8)  are  forms 
of  the  Kalmar  filter.  The  inovation  processes 

Pt(*s)  =  Vt  ~  J*  hxiiu{xs)du,  t>s, 

Pt  =yt~  [  huiudu,  t  >  0, 

Jo 

are  Brownian  motions.  They  generate  the  same  filtra¬ 
tion  as  {y<}. 

The  Gaussian  measure  on  R  with  mean  m  and  variance  P 
will  be  denoted  by  p(m,P,dx).  If  g  is  a  Borel  measurable 
function  on  R  we  shall  write 

r(j,m,P)=  f  g(x)p(m,P,dx). 

Jr 

If  Zt  is  an  integrable  process,  t  >  0,  II t(Z)  will  denote  the 
{yj} -predictable  projection  of  Z ,  so  U((Z)  =  E[Zt  |  Vjj  a_s. 
For  a  function  g(t,x)  such  that 

|?(f,z)|  <  K(\  +  |*|m) 

for  some  K  >  0,  m  >  0,  we  shall  write 

H<(y)  =  n<(y(f,i()). 

From  [2]  we  quote  the  following  results: 

Lemma  1.1.  a)  Suppose  0  <  3  <  t.  The  conditional  law 


IS 

p(mstP3,dx) 

Ps  f* 

+  —  I  -yuhvdpu 

(19) 

Is  J3 

Pi  ~  p‘ '  ($)'  f, 

(1.10) 

and  7  is  the  solution  of 


7<  =  1+  /  (as  ~  Ps^hsds  (1.11) 

Jo 

SO  ^ 

7<  =  exp  /  (a,  -  Psh\)ds. 

Jo 

b)  Suppose  g(t,  x)  and  gx(t,x)  are  Borel  functions  satisfying 
growth  conditions  as  above.  Then 

Ut(  j\(s,x3)ds)  =  J‘  n,(g)ds 

+  f  n,(  f  gz( u,xu)—  du)y3h3d03. 

Jo  Wo  7u  '  f  i  101 


FVom  (1.3)  we  see  the  map 

*  -  £s,t(* 

is  a  diffeomorphism  of  R  and 

a$4.,(x)  A/ 


=  *(»,0- 


FVom  (1.5)  we  can  write 

xt(x3)  =  $(s,t)[z3  +  £^,u)-1PJ,u/>u^u(*s)j  (1.13) 


dij(x,)  _ 
dx3  ~  7s>‘ 


7s, t  =!+•  j  (“u  ~  Ps,xih\)~t3,ud\i  (1.14) 
7s,f  =  exp  J  (a„  -  Pj,uh2)du.  (1.15) 


For  linear  signal  and  observations  the  Kalman  filter  pro¬ 
vides  a  finite  dimensional  solution  to  the  filtering  problem. 
Consider  a  measurable  function  /(t,  z)  on  [0,  oo]xfl  which 
is  twice  differentiable  in  x  and  which  satisfies  the  growth 
condition 

!/(«,*)! +  !/«(<.  *)!<*(!  + 1*1).  (2.1) 


Let  t  >  0  be  a  small  positive  number.  Consider  a  signal 
process  given  by  the  non-linear  equation 

*t=* 0+  /  (“s^s  +e/(s,zj))ds +<*;<.  (2.2) 

10 


Consider  the  process  z  defined  by 

Zt~XQ  +  Io  (2-3) 

where  fo.s(')  is  the  diffeomorphism  defined  by  (1.1). 
Lemma  2.1.  The  process  £o,t(rt)  is  the  solution  of  (2.2). 
PROOF.  Substituting  (2.3)  in  (1.3)  we  have 

(o,t(zt)  =  *(<M) [*0  +  J  *(0,s)_1e/(a,(o,s(*s))<fj 

+  j  <t(0,s)_1du>s].  (2.4) 
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Differentiating  (2.4)  in  t  the  result  follows. 

Remarks  2.2.  Because  /  satisfies  the  linear  growth  con 
dition  (2.1)  it  =  {o,t(*t)  has  finite  moments  of  all  orders. 

If  Zt  is  a  process  we  shall  write  Zt  =  0(ck)  if 

/_/  ,n\\  !/P  Ics 


(e(suP|Z,P))  IP  =  0(ek ) 


for  every  p  >  1. 
Notation  2.3.  Write 


PROOF.  Aj  =  1  +  J  K3h3DQ^dB3  and  the  result  fol¬ 
lows  by  substituting  for  A|  on  the  right  and  using  Propo¬ 
sition  2.4. 

From  Proposition  3.3  of  Picard  [2)  we  have 

Lemma  2.7.  n^A)”1  =  1  -eHt  ]j‘h3A^3dB3]  +  0(£2). 


The  main  result  is  the  following  theorem: 


A0t  =  $(0,0  /%(0,s)-1/(j-*s)<fc-  Theorem  2.8.  Writing  it  =  *t=4o,t(*o) 

'  Q  t 

E[xt  \  Yt\  =  E[xt  |  Yt\  +  cE[x,  f  hsA0^dB,  \  Yt\ 

Using  the  mean  value  theorem  we  can  quickly  deduce  JO 

+  eE[AQJ  |  Yt)  -  eE[xt  |  Yt]E[  f  h3Ao,sdB3  \  Yt 
r,  A  -  _  _  n. _ \.  i  -2\  ‘•JO 


Proposition  2.4.  xt  -  xt  =  D0,t  =  eA0)<  +  0(e2). 


REMARKS  2.5.  To  discuss  the  effect  of  the  non-linear  signal 
it  =  £o,t(2t)  on  the  observations  consider  the  measure  / 
defined  by 


\‘t  =  exp  (  jf‘  ft.Do^B,  -  I  J‘  h2D^ds). 


Then  under  P 


Bt  =  Bt-  f  hsD$  3ds 
JO 


is  a  Brownian  motion,  i.e., 


yt  =  f  hstOjMds  +  Bt. 
JO 


Therefore,  under  P  the  signal  process  is  x  and  this  now 
influences  the  observations  as  in  (2.5).  The  non-linear  fil¬ 
tering  expression  we  wish  to  consider  is 

I  Yt\. 


By  Baye’s  theorem  this  is 


(£[a?  iwr1. 


+  0(£2). 


Proof. 


E\xt\Yt\  =  E[\'txt\Yt]-E{\'t\Yt]-1 
=  B[Af(xt+eA0,,)|rt] 

x  E[(l  -  e  J‘  h^dB,)  |  Yt]  +  0{e 2) 

*  E  [ (l  +  £  J  h^dBs)  {xt  +  £Ao,r )  |  Yt] 
x  [l  -  cE[J*  hsA^dB,  |  y*]]  +  0{e2) 

by  Proposition  2.3  and  Lemma  2.7. 

REMARKS  2.9.  These  expectations  are  all  expressible  in 
terms  of  Gaussian  measures  because  they  are  all  expecta¬ 
tions  of  functions  of  the  original  linear  process  i(  under  the 
original  measure  P.  For  example,  E[xt  \  Y{\  =  x<  is  given 
by  the  Kalmar  filter.  The  remaining  terms  in  (2.6)  can  be 
expressed  in  a  recursive  way;  proofs  can  be  found  in  [1). 
For  example,  we  have 

Lemma  2.10. 

£1*0, t  i  y<5  =  J*  *(0,s)-ln4(/(s,x,))ds 


J,t 

I  h3 An  3dB3  +  0{e2). 
0 
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V 


3.  CONCLUSION 

As  in  the  paper  of  Picard  [2|  the  first  two  terms  in  an  ex¬ 
pansion  of  the  conditional  mean  in  powers  of  e  have  been 
determined.  These  coefficients  have  been  expressed  explic¬ 
itly  in  terms  of  Gaussian  measures  by  using  stochastic  flows. 
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